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SUMMARY 



This study is concerned with the optimal control of nonlinear sys terns 
■which operate in the presence of random unwanted di sturbanc es . Although the 
results are intended to be applicable to a certain class of nonlinear systems, 
saturating systems are emphasized because of their practical importance. Such 
systems are important when operation occurs in critical regions, for example, 
in the control of vehicles in situations where the available thrust is 
marginal . 


This report presents an approximate method of synthesizing the optimal 
controller with noisy measurements which utilizes the limited control function 
in the best possible manner. The principal results show that: (a) although 

there is no minimum, the performance can approach arbitrarily closely to a 
greatest lower bound, and (b) striking improvement in performance can be 
obtained in comparison with linear theory when operating in critical regions. 
Computer results are used for verification. In addition, dimensionless curves 
of the optimal performance are given as a function of a dimensionless param- 
eter involving the input statistics and saturation value of the forcing 
function . 




INTRODUCTION 


The optimal control of linear systems which operate in the presence of 
random unwanted disturbances has been the subject of intensive research for 
many years and appears to be fairly well understood. However much less has 
been done on the more important and more difficult nonlinear problem. 

In one approach, when there is a linear region of operation of the equa- 
tions, the nonlinear regions are intentionally avoided (ref. l) . The problem 
is treated as a linear variational problem with constraints by minimizing some 
function of the error with a constraint on another function of the control. 
Generally the constraint is placed on only the expected value or time average 
of the squared control function. Thus to insure that the equations remain 
linear, the constraint must be chosen sufficient so that the probability of 
exceeding the linear range is small . This method works quite well as long as 
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the linear range of operation is large. However, in critical situations where 
the linear range of operation is not large, this approach gives excessively 
large errors . 

Several other studies in recent years have been concerned with a rigorous 
account of the nonlinear aspect (as well as other aspects) of the stochastic 
control problem. These studies take various forms depending on the properties 
of the inputs, the sources of noise, the form of the nonlinearity, and the 
form of the plant. Recent extensive bibliographies and summaries of these 
results are given in references 2 and 3 * The setting for most of these studies 
has been the Chapman-Kolmogoroff equations or the related Fokker-Planck equa- 
tions which govern the behavior of the first probability density function. 

Such approaches hold much promise. At the present stage of development, how- 
ever, solutions to only the simplest examples can be obtained. 

What is needed is an intermediate approach. In this paper we will take a 
middle ground more closely allied with the former approach. The problem to be 
considered is roughly the Wiener filtering and control problem with the addi- 
tion of a zero-memory nonlinearity preceding the plant. The scalar problem is 
illustrated in figure 1. Here as in the Wiener problem the plant we wish to 
control is given by its transfer function. Preceding the plant is a zero- 
memory nonlinearity f . By far the most important nonlinearity and the one to 
be emphasized here is that due to saturation. However, a good deal can be 
learned by specifying only general properties of the nonlinearity. The input 
s(t) is the true signal entering the system. The measurement of the state of 
the system, or, alternatively, the incoming signal, is contaminated with 
unwanted noise n(t) . It is assumed that the inputs are stationary ergodic 
processes with known spectral densities, as in the Wiener theory. Thus we will 
not consider the first probability density function directly in the optimiza- 
tion. However, in the example we will take the noise to have a gaussian dis- 
tribution as is usually the case, and will show that results are not very 
sensitive to large variations in the signal distribution. And last, the con- 
troller will be free to choose so as to minimize E[e 2 (t)] or 
T 

lim(l/2T) f e 2 (t)dt while allowing operation of the system to extend into 
T-*°o J -T 

the nonlinear regions. That is, we want to have an optimization procedure for 
finding the best controller in which the system is allowed to operate in the 
nonlinear region. 


APPROXIMATE SOLUTION FOR THE OPTIMUM CONTROLLER 


The approach we take here utilizes the linearization of the nonlinearity 
as developed by Booton (ref. L) . This linearization idea has been widely used 
in analysis problems with much success, but not in synthesis problems. Accord- 
ing to this linearization method the nonlinearity f is rep laced by a scalar 
k which is dependent on E[u 2 (t)], the expected value, or u 2 (t) , the time 
average of the input to the nonlinearity (if the input is stationary and 
ergodic) . An inherent assumption in the choice of the scalar k is that the 
input to the nonlinearity is gaussian. This assumption may not be accurate due 
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to the nonlinearity in the system and due possibly to a nongaussian input 
signal. Nevertheless, we will see that the controllers derived here will pro- 
vide sufficient filtering that the approximation w ill he fairly good. Thus 
the approach is consistent with not considering the exact propagation of the 
first probability density function through the system. As a result of this 
approach it is clear that both the controller and the equivalent gain k of 
the nonlinearity are free and need to be determined so as to result in minimum 
error . 

As is generally recognized nowadays, a very convenient setting for 
stochastic problems and one promising generalization is a Hilbert space. 
Although there is more than one way the space can be defined, here the stochas- 
tic process x(t,i) wi ll be taken to be an element of a Hilbert space in which 
the inner product is either 

(v(t,i), w(t,j)) = E[v(t,i)w(T,j)] 

or 

nT 

(v(t,i), w(t + T,j)) = lim i / v(t,i)w(t + T,j)dt 

T-^oo £dl J -T 

depending on whether the events or the times are fixed. Although these inner 
products will be identical due to the assumed stationarity and ergodicity, 
time averages will be more convenient for experimental purposes. Usually the 
event i is suppressed in the notation. The norm generated from the above 
inner product is 


||v(t)|| 2 = (v(t), v(t)) < 00 


Thus we take 


JC - {x(t,i) : j|x(t,i)|| < oo, _oo < t < oo} 

Now redrawing figure 1 in the usual equivalent open-loop form because of 
linearity, we have figure 2. The box labelled H is assumed to be a linear 
operator H:x(t) -*■ u(t) of the form 


u(t) = Hx(t) = 


x(T)h(t - t ) dT 


where x(t) = s(t) + n(t), and is in JC. The operator P is similarly defined. 

The problem to be solved, stated abstractly, is to find 

MinHs(t) - PkHx(t)|j 2 (l) 

k,H 


subject to 


( 2 ) 


g(||Hx(t)f ) - k = 0 
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Note that the describing function g, which is the exact relation between k 
and UHx(t)|| 2 _, is not specified. One could attempt to solve equations (l) and 
(2) by looking for a stationary value by means of classical variational 
methods. However, this approach will not lead to a solution as will be seen 
later. Instead we will follow a different route. Separating the minimization 
into two steps and interchanging the order of the operations on x(t), we have 
the equivalent problem 


Min{Min||s(t) - kPHx(t)|| 2 } (3) 

k H 


subject to 


g(||Hx(t)|| 2 ) - k = 0 (4) 

Assuming g has an inverse, letting Z = kP and T = kPH, we see that equa- 
tions (3) and (4) become 

Min{Min||s(t) - Tx(t)|| 2 } (5) 

k H 


subject to 


||Z -1 Tx(t) || 2 = g-i(k) (6) 

Now consider the inner minimization of equation (5) subject to equa- 
tion (6) . It is known that a sufficient condition for an absolute minimum of 
this inner minimum is that 

ils(t) - Tx(t)f + A|lz-^(t)f (7) 

attain an absolute minimum, where A is an unknown multiplier. The absolute 
minimum of equation (7) is expressed by the following. 

THEOREM: Let Y be a closed convex subset of a Hilbert space JC . 

G-iven any s(t)e JC, then a necessary and sufficient condition for the 
existence of a unique y Q eY satisfying 

||s(t) - y Q (t) || 2 + A||z-V 0 (t)|| 2 < ||s(t) - y(t)f + A||z _;i y(t) || 2 for all y 


(8) 

is that 

(y(t), s(t) - Uy 0 ( t ) ) = 0 for all y(t) (9) 


where 


U = I + AZ -1 *Z -1 


and * denotes the adjoint operator. 
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The proof is sketched in appendix A. Equation ( 9 ) is another form of 
the Wiener-Hopf equation which accounts for the restriction on the control 
function first developed by Newton (ref. l) by variational principles. It 
should be noted that this theorem insures the existence and uniqueness of an 
absolute minimum rather than only a stationary value. This equation is 
appealing because it maintains close contact with the geometrical notion of 
orthogonal projection. That is, it says that the optimum y Q vector is one 
which makes the optimum error vector s(t) - Uy 0 (t) orthogonal to all arbitrary 
y(t)eY. 

The applicability of the preceding theorem is clear from an examination of 
the set Y, consisting of output vectors, which is generated by the mapping 
T:x(t) -» y(t) • This mapping produces the output set Y such that 

Poo 

Y = (y(t) : y(t) = / x(r)q(t - t )dT for all t,xeJC} 

J — 00 


It is well known that as long as T satisfies the condition 


pco poo 

J J Il(t-T )| 2 

J —00 u —00 


dt dT < 00 


T will be linear, bounded, and completely continuous. Thus from the bounded- 
ness, j(y(t)|j < Mjjx(t)jj < 00 for all x(t)e JC for some M > 0 so that 
y(t)eJPor Yc 7C. Also from the complete continuity of T, Y is compact and 
therefore closed; Y is also convex. 

Now consider the minimization over k as given in equation (5) • We can 
show what this step involves by examining the properties of the operator T 
which are contained in the orthogonal, projection theorem of equation (8) . Let 
k be arbitrary. Then take Ai and A 2 to be two values of A in equation (8) 
such that 0 < Ai < A 2 , and let y and y 2 be the corresponding optimum output 
vectors. Then for these two values of A we have, from equation (8), 

||s(t) - y a (t)jf + A 2 |lZ~ ;i y 2 (t)|| 2 < jjs(t) - yi(t))| 2 + A 2 jjZ-iy 1 (t)|| 2 (10) 


l|s(t) - yr(t)|J 2 + Aijjz Vi( t )|l 2 < ||s(t) - y 2 (t)|j 2 + Ai||z ^(tOjj 2 (11) 


Solving equation (ll) for (t ) - y 1 (t)j| 2 and substituting in equation (10) we 
see that 

||s(t) - y 2 (t)f + A 2 ||Z-iy 2 (t)|| 2 < ||s(t) - y 2 (t)||a + AjjlZ" 


- Hz-v^t)!! 2 ] + A s |iz-v l (t)H s 
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or 


A 2 [!|z - 1 y 2 (t )|| 2 - Hz ViCOII 2 ] < Aitjjz V 2 (t)ll 2 - |jz-iy 1 (t)|j 2 ] 

Thus we conclude 

ll z " 1 y 2 ( t )|l 2 < !i z 'V 1 (t)|| 2 (12) 

Considering equations (12) and (ll) we see 

||s(t) - y x (t)f < ||s(t) - y 2 (t)|| 2 ( 13 ) 

Thus the operator T which makes equation ( 7 ) attain an absolute minimum has 
the monotonic property 

Ax<a 2 +> nz-v 2 (t)|| 2 < ilz-V^t)!! 2 

* l|p _ 1 y 2 (t )|! 2 < ir^t )!! 2 

||s(t) - y i (t ) || 2 < ||s(t) - y 2 (t)jj 2 (ik) 

Obviously, this property holds for arbitrary linear plants. 

To continue the minimization over k we must assume some properties for 
the describing function g. A particularly important class of describing 
functions is that described by the property that k 2 g'~ :L (k) is a monotonically 
decreasing function. For example, the describing function for a saturation 
nonlinearity or a relay satisfies this property. Now consider two values of 
k, ki < k 2 * Then from the above property and equation (6), we will have 

ki < k 2 => j|P-iy 2 (t)|| 2 < )|P _1 y 1 (t ) || 2 (15) 


Then from the property of the optimum operator given in equation (l4) , 

ki < k 2 => ||s(t) - yj.(t ) < |js(t) - y 2 (t )|| 2 ( 16 ) 


Now if the describing function is assumed to be restricted further by the 
commonly occurring property 


0 < k < 1 

it will be clear from the monotone property in equation (l6) that there will 
be no minimum error, that is, no minimum of equation (5) subject to equa- 
tion (6) . Note that this conclusion has not required the exact form of the 
describing function g to be specified other than by its general properties 
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that it have an inverse, be greater than zero, and k 2 g _1 be monotonically 
decreasing. This conclusion also shows that the stationary value which is 
sought in the variational approach does not exist. 

Even though there is no minimum, from a practical viewpoint, one would be 
interested in determining the greatest lower bound, gib, of performance, that 
is. 


glb{Min|js(t) - Tx(t)|! 2 } ( 17 ) 

k H 

subject to 

||Z _ 1 Tx(t ) || 2 = g-^k) (18) 


However, to do so, more must be assumed about the nonlinearity. Because of its 
obvious practical importance it will be assumed that the nonlinearity is due 
to saturation. In this case we may find the exact form of g-i in equa- 
tion (l8) as k -*■ 0. For, from an analysis of the saturation describing func- 
tion, it is known (ref. 4) that 


k 

||Z- 1 y(t)||/L 


as 


||Z _I y(t)|| 


where L is the saturation value for the nonlinearity. In other words , 

ll z_1 y(t)|| 2 = ||z -1 Tx(t ) j| 2 -* | ~ as k -» 0 (19) 

Thus as the error becomes smaller as a result of decreasing k, this expression 
may be interpreted as the behavior of the restriction equation (l8) by defin- 
ing g -1 . But since, by definition Z = kP, equation ( 19 ) becomes 

||P _1 Tx(t)|l 2 -*• | L 2 as k -* 0 


Then since glb{k} =0, the above relationship together with, the property in 

equation (15) implies lub{||P -a Tx(t)|| 2 } = 21^/n. Using this fact and the 

k 

property in equation (l4) , equations ( 17 ) and (l8) are equivalent to 

Min||s(t) - Tx(t)|| 2 (20) 

H 


subject to 

UP-^TxWf = l|f[u(t)]|| a = | Z? (21) 
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The solution to these equations by conventional methods then gives the limiting 
value of performance. Note that no assumptions other than linearity are made 
concerning the plant. Although equation ( 19 ) is valid for a saturation non- 
linearity, one could arrive at similar results for other nonlinearities by 
examining the limiting behavior of equation (l8) for that particular 
nonlinearity. 

It is apparent now that the optimum performance for the saturating case 
is related directly and simply to the performance for the completely linear 
case. In the linear case (denoted by subscript L) , in which f = 1, equa- 
tions (20) and (2l) become 


Min|(s(t) - Tx(t) 



subject to 


||u(t)||k = constant 


( 22 ) 


(23) 


In comparing the performance for the saturation case (denoted by subscript s) 
with the linear case, we see that 

l|u(t)|| L = ||f[u(t)]|| s = Jl 

will imply 

|| s (t ) - Tx(t)|| s = 1 1 s ( t ) - Tx(t) || L 

Thus the gib of the nonlinear error performance, as a function of the satura- 
tion level L, is the same as the optimum li near error performance as a func- 
tion of ||u(t)|| where ||u(t)|| is replaced by ^2/ it L. 

In order to illustrate the comparative performance between the linear and 
nonlinear cases it will be expedient to take an example . Since the details of 
the example are unimportant, we mention only that the example represents a 
hypothetical interception problem taken from a later section. For this example 
the optimum linear performance, where f = 1, is given in figure 3* In order 
to achieve results predicted by linear theory, it is customary to design such 
that ||u(t ) 11^ = L/2 so that the system remains essentially linear. However in 

the nonlinear case we have seen that the gib of the error performance occurs 
when ||f[u(t)]|| = \j2/n L. Thus there is a 60 percent increase in effective con- 
trol in comparison to the linear case. This increase may be significant 
depending on the value of L. For example, in figure 3 it is clear that an 
increase in ||u(t)|| by a factor of 1.6 will not be of much value in reducing 
minimum error at point A where ||u(t)|| is large, but it will offer great 
reduction in error at point B where |iu(t)|| is small. This comparison is 
shown even better perhaps in figure 4 (obtained in an obvious way by the dis- 
cussion of the preceding paragraph) where the performances of these two systems 
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are given as a function of the saturation level L. (Note that for metric 
units in figures 3 and 4, 1 ft = 0 . 30 ^ m and 1 g = 9^0*7 cm/sec 1 2 * .) 

Up to now only the gib of the error performance for the saturating 
system has been discussed. Even though this performance is not attainable 
from a practical, viewpoint we are interested in obtaining performance which is 
reasonably close to the gib. Thus it will be desirable to consider how the 
system should be designed so that its performance will be close to this gib. 
This can be done by considering the describing function characteristic given 
in figure 5 where the dimensionless m = ||f[u(t) ]||/L is given as a function 
of the equivalent gain k. For a given L and any choice of m, 

j|f[u(t)]J| = mL , 0 <m<J 

and the corresponding error performance is obtainable from figure 3 * Hence one 
may choose the value of m so that the error will be satisfactorily close to 
the gib performance. The decision regarding this choice of m can best be 
shown in figure 4 where the performance is shown for several values of m. 


DIMENSIONLESS PERFORMANCE CURVES 


It will be the purpose of this section to present some dimensionless 
performance curves for the saturating system. The motivation here is that one 
would like to be able to draw some general conclusions regarding optimal per- 
formance. A similar approach for linear systems was taken at about the same 
time by Coales (ref. 5 ) and Stewart (ref. 6), although the details of the two 
studies are slightly different. Since it is not possible to choose a system 
which is optimal for all inputs and plants, some narrowing of the task was 
required to carry out this approach. In both the above studies, the class of 
inputs and plants was restricted to a special but yet very important class 
practically. From these assumptions a set of dimensionless curves were 
obtained which are useful in determining optimal linear performance and the 
design of the optimal linear system. 

Similar dimensionless performance curves for the saturating system may be 
obtained because of the relationships developed earlier. Since we utilize the 
results of reference 6 for linear systems, it will be desirable to summarize 
the assumptions in this reference along with a few remarks: 

1. The class of inputs was restricted to a very common and important 
form which occurs in many physical problems; the power spectra of the 

signal and noise were defined, respectively, by 4> s (w) = 0 / u) 4 (cj 2 + |2) an q 

%( w ) - N. This form for the signal is valid for many stationary and non- 

stationary processes. Furthermore, this form may often approximate a 
variety of experimentally determined input data. The other function for 
the noise is approximated by a constant, and this is a good approximation 
when the noise bandwidth is larger than the resultant system bandwidth . 
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2. The plant was assumed to be of the form c/s 2 . Although the 
plant will generally be much more complicated, it was found that the more 
complex form is not only often unnecessary but undesirable . That is, the 
more complex form can often be approximated by the simpler form c/s 2 . 
Moreover, it was shown (ref. 6) that the effect of additional dynamic 
terms is detrimental to optimum performance so that the simpler form 
should be striven for when there is control over the plant dynamics. 

With these assumptions, the dimensionless error can be determined as a function 
of the dimensionless control function when the system is linear. This rela- 
tionship is given in f igure 6, where the dimensionless parameters 0 and v are 

defined as: (3 = ^/a/w and v = |/(3. (Note that in fig. 6, 32.2 is a scalar 

without dimensions. Thus ||u(t ) ||//W0 5 is dimensionless.) 

The corresponding dimensionless curves for the saturating system parallel 
figures 4 and 5 for the specific example discussed earlier. First, figure 7 
gives the dimensionless gib of the error as a function of a dimensionless 
parameter Z defined by Z = L/32.2 W 1 ^ 2 ^ 5 ^ 2 , where L is the saturation 
level of the forcing function. (Again note that both 32.2 and l/n 1 ' /2 0 5/2 are 
dimensionless.) These curves, valid for any set of conditions, might be useful 
in several ways . They might be used to determine the best performance which 
could be achieved in a specific case for purposes of comparing with other sys- 
tems to indicate possibilities for improvement. They might also be used in 
preliminary design to evaluate the relative importance of those factors affect- 
ing the optimum performance. Second, in figure 8, the nonlinearity character- 
istic is given in dimensionless form. This figure, in conjunction with 
figure 6, is useful in deciding how close to the gib curve one wants to be. 
The detailed design of the optimum controller can be accomplished by combining 
the results in this paper with those of reference 6. 


EXPERIMENTAL RESULTS 


Since the results presented earlier depend on the describing function 
approximation, it is important to investigate the validity of this approxima- 
tion. One expedient way of investigating this approximation is by means of an 
analog computer simulation, the results of which will be described briefly. 

The example chosen for the simulation was a hypothetical interception 
problem in which the target executes a constant amplitude switching of acceler- 
ation with a Poisson distribution for the length of time between switches. The 
spectrum for such a function is known to be 


$ (w) = Ka 2 / tfm 4 (k 2 + w 2 ) 
s 


so that the dimensionless curves just presented are applicable. The other 
functions, the noise and plant, are assumed to be of the form described 
earlier, that is, the noise spectrum is a constant and the plant is of the 
form c/s 2 . The following typical numerical values for the parameters were 
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taken: a = O.968 g, K = 0.431, and IT = 15 ft 2 / rad/ sec. Two values of the 

saturation level of the forcing function were chosen as L = 2.87 g and 2.3 g. 
The systems were designed so that the theoretical errors were reasonably close 
to the gib curve as indicated in figure 4. 

The experimental results which were obtained (using norms based on time 
averages for convenience) are shown in figure 4, and the errors may be seen to 
be reasonably close to the theoretical values with which they should be com- 
pared. Also see table I for the comparison. It is difficult to estimate the 
accuracy of the experimental results because although the measurements extend 
over a few minutes the results varied somewhat with different noise and signal 
sample time histories. 

Several other interesting experimental results were obtained which are 
difficult or impossible to examine analytically. We itemize these results in 
the following. First, measurements were made directly from experimental data 
of the distribution at the input to the nonlinearity and the equi valent gain. 
Although data cannot be given here, the distribution was exceptionally normal 
and the equivalent gain calculated from the well-known relation 

uf(u)p(u)du 

r_oo u 2 p(u)du 


was in excellent agreement with theory. Second, the saturating element was 
replaced by a constant gain equal to the theoretical value for which the sys- 
tem was designed. The experimental value for the error performance is given 
in table I; it agrees well with the theoretical value as it should. Third, the 
effect of the first probability density function of the signal on the results 
was examined. Interest centers on this effect because the theory presented 
depends on only the second probability density function. However, it is clear 
that a rigorous account of nonlinear system behavior must depend on the first 
probability density function. Thus if the method is to be useful, the results 
must not be very sensitive to the first probability density function. To 
investigate this effect two signals were chosen with the same spectral densi- 
ties but with widely different first probability density functions. The dis- 
tribution of the random square-wave of acceleration used earlier was, of 
course, two impulses, at +a and -a. In addition, a signal with the same 
spectrum but with a gaussian distribution was used. From the results indicated 
in table I it appears that the error for the gaussian case is fairly close to 
but slightly greater than for the random square-wave signal. Since the differ- 
ence between these two distributions is extreme, it appears that the results 
are fairly insensitive to distribution. Fourth, a series of experimental runs 
were made to investigate the local behavior of the error performance for the 
saturating system with the random square-wave signal. That is, since the 
theory presented is only approximate, it is of interest to measure the gradient 
of the error with respect to the parameters, op , of the optimum controller, or 
more properly Ae/Zto,j_. The controller, which is given by the ratio of a 
second-order polynomial to a third-order polynomial, contains six parameters. 

By varying each of these parameters individually and sufficiently to cause a 
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small change in error , Ae/Axj_ was found to he positive for each parameter Oj_. 
Thus the design was experimentally verified to be optimum, at least locally • 


CONCLUDING REMARKS 


The method given here shows that when operating in critical regions one 
can obtain significant improvement over linear performance by nonlinear opera- 
tion. The method is appealing because it agrees with ones intuitive notions 
concerning optimum performance for saturating systems. However, the validity 
of the method depends on the accuracy of the describing function concept which 
generally cannot be predicted a priori. The simulation results indicate the 
approximation is valid to about the same accuracy as is usually associated with 
the describing function. 


Ames Research Center 

National Aeronautics and Space Administration 
Moffett Field, Calif., Feb. 2b, 1966 
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APPENDIX A 


PROOF OF THEOREM 

THEOREM: Let Y be a closed convex subset of a Hilbert space Jc . 

Given any s(t)eJC, then a necessary and sufficient condition for the 
existence of a unique y Q €Y satisfying 

|| s (t) - + AjjZ 1 y o ('t ) || < ||s(t) - y(t)|| a + a||z 1 y(' t )ll for all y 

(Al) 

is that 

(y(t), s(t) - Uy G (t) ) =0 for all y (A2) 

■where 

U = I + AZ _ X *Z ~ 1 (A3) 

and * denotes the adjoint operator. 

To prove the existence of a minimizing vector, let 

m = glb{||s(t) - y(t)|j 2 + Aj|Z-V(t)!| 2 : yeY} 

Now choose a sequence [y q ] such that 

||s(t) - y q (t)|| 2 + Aj|Z _2 y q (t)|| 2 - m 

It can be shown that {y q } is a Cauchy sequence. For by the parallelogram law, 
Ibp " y q f + A||z- a (y p - y q )|| 2 = 2(||y p - s|| 2 + Al^-^pf) 

+ 2 (II s - Yqll 2 + 

- 4 II | (y P + y q ) - s || 2 

- 4 II Z_1 \ (y p + y q ) II s (Ah) 
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Due to the assumed convexity property of Y and the definition of m, the 
last two terms are less than -4m. Hence 


||y p - yq.ll 2 + A||Z 1 (y p - y q )|l 2 < 2(||y p - s|| 2 + A||z-iy p || 2 ) 

+ 2(||b - y q || 2 + A||z-iy q || 2 ) - 4m 


-> 0 

because of the way in which the sequence was chosen as described following 
equation (A3). Thus {y q } is a Cauchy sequence. Since Y is a closed subset 
of JC , it is complete, so that y q -*• y Q e JC . It will then follow that 

II s - Yqll 2 + ^llZ-Vqf || s - y o |j 2 + AHz-VqII 2 

Thus 

II s - y 0 ll 2 + a|1z _ VqII 2 = m 

and the minimum is actually attained. 

To prove uniqueness, assume there are two elements y and z Q in Y that 
are optimum. Let the minimum value be m. Now consider 

l|y 0 - -oil 2 + A ll z_ 1 (y 0 - z 0 )ll 2 

By means of the parallelogram law we can show, as in the preceding paragraph, 
that 


l|y 0 - Z 0 II 2 + A H Z Hy 0 - z 0 )ll 2 < 0 

Hence it follows y Q = z Q and the optimum is unique. 

To find the necessary and sufficient condition which y Q must satisfy, 
we consider the following expression which can be expanded as follows 

II s - y|i 2 + 4 z_1 y|l 2 = II s - y 0 ll 2 + A ll z_1 y 0 ll 2 + lly - y 0 ll 2 


+ A||z-i(y - y Q ) || 2 - (y - y Q > b - y Q ) 


+ a(z 1 (y - y 0 ), z Vq) - (y - y D > s - y Q ) 


+ A(Z -1 y 0 , Z -1 (y - y Q )) 


(A5) 
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Using the adjoint operator denoted by * 


(y - y Q > s - y D ) + a(z 1 (y - y Q ), z Vo) = (y - y 0 > s - uy Q ) = (y> s - u y 0 ) 

(A 6) 

where 

U = I + AZ-^Z" 1 

and y - y c is an arbitrary element of Y and is relabelled as y. Now 
equation (A5) becomes 

II s - yll 2 + Allz-^r - lls - y 0 l! 2 + A||z-xr + lly - y 0 f 

+ Mlz^y - y 0 )|| 2 - 2R e (y' s - u y 0 ) (ay) 

It is clear that a sufficient condition for y Q to satisfy equation (Al) is 
that 

(y, s - Uy Q ) = 0 for all y (A8) 

For necessity, we assume equation (Al) holds. Then in view of equa- 

tion (A7), it will be necessary that 

lly - y 0 l! 2 + A l|z _1 (y - y 0 )ll 2 - 2R e (y> s - u y 0 ) > 0 for a11 ar ( A 9) 

If p is any scalar, py belongs to Y. Hence for (A 9 ) to hold for all y, 
it will be necessary that 

lly - y Q ll 2 + A|jz -1 (y - y 0 )jj 2 - 2pR e (y, s - Uy Q ) >0 

for any scalar p. This will require 

(y, s - Uy 0 ) = 0 for all y (AlO) 


15 


REFERENCES 


1. Newton, G. C., Jr.: Compensation of Feedback Control Systems Subject to 

Saturation. J. Franklin Inst., vol . 254, no. 4, Oct. 1952, pp • 281 - 296 ; 
and no. 5> Nov. 1952, pp • 391-413 • 

2. Wonham, W. M.: Stochastic Problems in Optimal Control. IEEE Internatl. 

Convention Record, vol. 11, part 2, March 1963 * PP • 114-124. 

3* Kushner, H. J.: On the Differential Equations Satisfied by Conditional 

Probability Densities of Markov Processes, With Applications. Tech. 

Rep. 64-6, RIAS, March 1964. 

4. Booton, R. C., Jr.: Nonlinear Servomechanisms With Random Inputs. Rep. "JO, 

Massachusetts Inst. Tech., Aug. 1953* 

5- Coales, J. F and Lawrence, P. J.: The Preparation of Charts and Tables 

for the Optimization of Automatic Control Systems With Random Inputs. 
Proceedings of the First International Congress of the International 
Federation of Automatic Control, vol. II, Butterworths , London, 1961 , 

PP- 753-760. 

6 . Stewart, E. C.: An Explicit Linear Filtering Solution for the Optimization 

of Guidance Systems With Statistical Inputs. NASA TN D- 685 , 1961 . 


16 


TABLE 1.- COMPARISON OF THEORETICAL AND EXPERIMENTAL RESULTS 
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Figure 1.- Nonlinear filtering and control problem. 
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Figure 2.- Equivalent open-loop problem. 
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ACCELERATION ||u(t)||,g 

Figure 3 • - Example error performance for linear system. 
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Figure 4.- Example error performance as a function of saturation level. 
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DIMENSIONLESS CONTROL 
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Figure 7.- Dimensionless performance for saturating system. 
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